Method for Generating Long-Range Correlations for Large Systems 
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We propose a new method to generate a sequence of random numbers with long-range power- 
law correlations that overcomes known difficulties associated with large systems. The new method 
presents an improvement on the commonly-used methods. We apply the algorithm to generate 
enhanced diffusion, isotropic and anisotropic self-affine surfaces, and isotropic and anisotropic cor- 
related percolation. 

PACS numbers: 



I. INTRODUCTION 



Recently, the study of physical systems displaying 
long-range power-law correlation has attracted consider- 
able attention. Long-range correlations have been found 
in a wide number of systems including biological, phys- 
ical, economical, geological and urban systems |^]. At- 
tempts to study and characterize such systems are often 
based on numerical methods to generate correlated noise 
One of the most used methods to generate a se- 
quence of random numbers with power-law correlations 
is the Fourier filtering method (Ffm) 1^,^,1). It consists 
of filtering the Fourier components of a uncorrelated se- 
quence of random numbers with a suitable power-law fil- 
ter in order to introduce correlations among the variables. 
This method has the disadvantage of presenting a finite 
cutoff in the range over which the variables are actually 
correlated |^-|^. As a consequence, one must generate a 
very large sequence of numbers, and then use only the 
small fraction of them that are actually correlated (this 
fraction can be as small as 0.1% of the initial length of 
the sequence U,^). This limitation makes the Ffm not 
suitable for the study of scaling properties in the limit of 
large systems. 

Here we modify the Ffm in order to remove the cutoff 
in the range of correlations. We show that in the modi- 
fied method the actual correlations extend to the whole 
system. We also apply the method to generate several 
systems such as fractional Brownian motion, self-afhne 
surfaces and long-range correlated percolation. 



II. FOURIER FILTERING METHOD 



We start by defining the Ffm |y,y,|5|| for the d = 1 case 
{d is the dimension of the sample). Consider a stationary 
sequence of L uncorrelated random numbers {ui}i=i,..,L. 
The correlation function is {ui Ui+e) ~ Si^o, with Si^o the 
Kronecker delta, and the brackets denote an average with 
respect to a Gaussian distribution. The goal is to use the 
sequence {ui}, in order to generate a new sequence, {rji}, 



with a long-range power-law correlation function C{i) of 
the form 



oo 



(1) 



Here, 7 is the correlation exponent, and the long-range 
correlations are relevant for < 7 < d, where d — 1. The 
spectral density S{q) defined as the Fourier transform of 
C{£) has the asymptotic form 



Siq) = iVq V-q) ^ Q 
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Here {rjq} correspond to the Fourier transform coeffi- 
cients of {rjj}, and satisfies 



(3) 



where {uq} are the Fourier transform coefficients of {ui}. 

The actual numerical algorithm for Ffm consists of the 
following steps: 

(i) Generate a one-dimensional sequence {ui} of uncor- 
related random numbers with a Gaussian distribution, 
and calculate the Fourier transform coefficients {uq} 

(ii) Obtain {77^} using (||) and (|^). 

(Hi) Calculate the inverse Fourier transform of {rjq} to 
obtain {rji}, the sequence in real space with the desired 
power-law correlation function (m. 



III. PRESENT METHOD 

The Ffm method has been applied in a number of stud- 
ies of correlated systems However, an analysis 
of the method for large L shows that, by following the 
above procedure, one ends up with a sequence of corre- 
lated numbers whose range of correlations, for d = 1, is 
only about 0.1% of the system size. For example, from 
an initial sequence of 10^ numbers, only 10'^ numbers 
show the desired power-law correlations For d = 2, 
the range of correlations increases to 1% of the system 
size [||. In order to remove this artificial cutoff in the 
correlations, we modify the Ffm algorithm as follows: 

(a) To calculate the spectral density S{q), a well- 
defined correlation function in the real space is needed. 
The function C{£) = i^'' has a singularity at ^ = 0. We 
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replace with a slightly modified correlation function 
that has the desired power-law behavior for large £, and 
is well-defined at the origin 



(4) 



(b) The relation ^ is based on the convolution theo- 
rem, and therefore the desired correlation function (Q) 
must satisfy the proper periodic boundary condition. 
The function C{£) can be naturally extended to nega- 
tive values of £ due to the £'^ dependence. We define 

in the interval [—L/2,...,L/2], and impose periodic 
boundary conditions, i.e. C{£) = C{£ -\- LY 

(c) The discrete Fourier transform of (Q) — needed to 
obtain rjq using — can now be calculated analytically. 



S{q) 



r(/3 + i) 
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where q takes values q — lixmlL with m = —Ljl^ L/2, 
Ki3{q) is the modified Bcssel function of order (3 — 
(7 — l)/2, and F is the Gamma function. 

The modified Bessel functions satisfy the asymptotic 
relations 
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(6) 



for (3 positive and by definition if_/3 = K/^. Then for 
small values of g, (g|) gives the same asymptotic form 
as (||). However, the Bessel function introduces a cut- 
off for large q in the sense that S{q) has a faster expo- 
nential decay. This cutoff, while irrelevant to the long- 
distance scaling, is very important for the validity of the 
whole Fourier analysis because it avoids aliasing effects 
(see Chapter 7 in ||]). The cutoff in the Fourier space is 
thus responsible for eliminating the cutoff in real space 
observed in the Ffm method. 

In order to perform the above steps numerically, we 
employ the Fast Fourier transform Due to the 

periodic boundary condition imposed on the correlation 
function, it follows that the correlated sample satisfies 
the same periodicity. If one requires a sequence with 
open boundary conditions, we generate twice as many 
numbers and then split the sequence in two parts [ pj]| . 

To test the actual correlations of the generated sample 
we calculate C{£) averaging over different realiza- 
tions of random numbers. Figure ^ shows a plot of the 
actual correlations obtained for different values of 7 and 
for a sequence oi L = 2^^ numbers. It is seen that the 
long-range correlations exist for the whole system. The 
nominal values of 7 obtained from the best fits are also 
the same, within the error bars, as the desired input val- 
ues. 

To summarize the method, the correlation function we 
propose is well-defined and satisfies the correct power- 
law behavior in the real space. Its Fourier transform has 
the correct power law at small frequencies, and presents 



a cutoff for large frequencies that avoids aliasing effects, 
and leads to the infinite long-range behavior in real space. 
An alternative method in which S{q) was calculated nu- 
mericaly, in contrast to the analytical expression (^, is 
given in Il2]. 



IV. APPLICATIONS 



In the following we apply the proposed method to sev- 
eral physical problems. 



A. Generating fractional Brownian motion (fBm). 

We map the variables {m} onto the steps of a corre- 
lated random walk, and define the position of the walker 
at step t by x{t) = J2i=i Vi- Then, x{t) corresponds to a 
i-step fBm, and the sequence of increments {rji} is called 
fractional Gaussian noise (fGn) ||l3|| . An important quan- 
tity is the mean-square displacement of the fBm whose 
asymptotic behavior is 



-a:(to)n ~ \t-tQ\ 
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Thus the long-range correlations lead to enhanced dif- 
fusion (\x(t}-x{to)\^) ~ \t-to\^" for < 7 < 1 with 
H = 1 — 7/2 Figure ^ shows the plots of the mean 
square displacement for different degree of correlations. 
The fits confirm the validity of the long range correlations 
among the variables in the whole system size. 



B. Generating long-range correlations in d 
dimensions. 



The algorithm can be easily generalized to higher di- 
mensions. In a d-dimensional cube of volume L"^ the 
desired correlation function takes the form 



-7/2 



C{£) 



(8) 



with the corresponding periodic boundary condition, 
C{£) = C{£ + L). The spectral density is 



S{q) 



27r'^/^ 
T{(id + 1) 
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where q — \q\, qi = 2Tmii/L, — L/2 < < L/2, 
i = 1, d, and (3d — {"1 — d)/2. In the two-dimensional 
case the correlated variables are defined in a xy square 
lattice {rjij}. Figure ^ shows a test of the actual corre- 
lations obtained in two dimensions for different degree of 
correlations, and for a system oi L = 2^^. 
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C. Generating fBm in two dimensions 

The two-dimensional correlated numbers can be 

used to generate two-dimensional fBm. We propose the 
following definition 

t s 

1=1 j=i 

After some algebra, we find that when the numbers 
{rjij} are long-range correlated then 

{\h{t, s) - h{to, so)n ^\{t- +{s- son--'/' (n) 

Thus, using the correlated numbers with < 7 < 2, fBm 
can be generated with exponent given by _ff = 1 — 7/2 
and < < 1. A landscape with this scaling behavior 
is also called self-affine surface [ p7| . 



present here allows us to study this problem in the limit 
of large systems. Figure^ illustrates the results obtained 
for site percolation on a square lattice of 1024 x 1024 sites. 
We see that the introduction of long-range correlations 
among the occupancy variables strongly affects the mor- 
phology of the system. In the correlated case the clusters 
look more compact than in the uncorrelated case. The 
lack of correlations in the uncorrelated case is seen from 
the presence of many small black holes inside the large 
clusters (Fig. ^). Also, at small concentrations there 
are only small clusters (Fig. ^) while for the correlated 
case, large clusters are present even at low concentration 
(Fig. |a). 

We wish to thank R. Cuerno, P. Jensen, P. R. King 
C.-K. Peng, S. Prakash, R. Sadr, and S. Tomassone for 
discussions. We thank K. B. Lauritsen for discussions 
leading to (0). The authors thank BP and NSF for fi- 
nancial support. 



D. Generating anisotropic long-range correlations 



Many physical systems display not only correlations 
but also anisotropy reflected in different correlation 
exponents along different directions. We generalize the 
algorithm for this case. We propose a correlation func- 
tion suitable for two-dimensional anisotropic systems 



C(r, ip) — r 



cos^ ip - 
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where (r, ip) are the polar coordinates. The spectral den- 
sity is 



7r3/2r(l + /3,/2) cos^y, 
2i-'3^r(2 - /?,/2) qP^ 
7r3/2r(l + /3^/2) sinVg 

2i-/3«r(2-/3j,/2) qPy 



(13) 



with /3a; = 2 — 7j;, and /3y = 2 — 7^. Then the proposed 
method can be applied to generate anisotropic correlated 
numbers. This method might be suitable for the sim- 
ulation of geological reservoir systems for which strong 
anisotropy is found |l|. Moreover, after generating the 
anisotropic variables 77, we can apply the procedure out- 
lined in C in order to obtain an anisotropic self-affine 
surface. 



E. The correlated percolation problem 

A qualitative check of the impact of long-range corre- 
lations for physical systems can be obtained by applying 
the proposed method to a concrete physical problem: the 
correlated percolation |jl^ . The properties of long-range 
correlated site percolation in the square lattice have been 
recently studied ^. However, these studies were limited 
to systems not larger than 104 x 104 sites. The method we 
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FIG. 1. A log-log plot of the average correlation C{£) of 
50 correlated samples obtained with the proposed method for 
L = 2^^. Shown are results for different values of the desired 
7 = 0.2, 0.4, 0.6, and 0.8 (from top to bottom). The dashed 
lines represent the best fits which yield the nominal values 
of 7 = 0.19 ± 0.02, 0.39 ± 0.02, 0.60 ± 0.03 and 0.79 ± 0.03. 
The correlations are calculated until L/2 due to the periodic 
boundary conditions. 



FIG. 2. Log-log plot of the mean square displacement for 
the fBm, for the same values of the desired 7 as in Fig. 1 (from 
bottom to top). The slopes of the linear fits yield 2 — 7 = 
1.78±0.02, 1.60±0.02, 1.42±0.03, and 1.23±0.03 respectively, 
in agreement with (7). 

FIG. 3. Log-log plot of the correlations along the diagonal 
direction in a square lattice of 2^^ x 2^^. Shown are results 
for different values of 7 =0.4, 0.8, 1.2 and 1.6 (from top to 
bottom), and we take averages over 50 samples. The fits yield 
nominal values of 7 = 0.41 ±0.02, 0.81 ±0.03, 1.20 ±0.03 and 
1.59 ± 0.04. 

FIG. 4. Site percolation in the square lattice of 1024 x 1024 
for different degrees of correlations and concentrations. Fig- 
ures 4a and 46 correspond to the correlated case with 7 = 0.2, 
while Figs. 4c and 4d correspond to the uncorrelated perco- 
lation problem, below and at the threshold for both cases, 
respectively. Unoccupied sites are in black and occupied sites 
are in white. Figure 4e shows the case of anysotropic per- 
colation generated with the method of D for = 0.2 and 
7y = 1.8, and for the same concentration as in Fig. 4a. We 
notice how the clusters are elongated along the direction of 
the smaller exponent (strong correlations). The figures are 
generated using the same seed for the random number gener- 
ator. 
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